Appl. No. 10/016,941 

Amdt. dated February 13, 2007 

Reply to Office Action of November 1 3. 2006 

Amendments to the Claims; 

This listing of claims will replace all prior versions, and listings, of claims in the application: 
Listing of Claims ; 

1 (Currently Amended). A method of presenting information regarding a video 
comprising a plurality of frames comprising: 

(a) summarizing a video, said summarization comprising a plurality of 
segments of said video based upon an event characterized by a semantic 
event that includes a play, where each of said segments includes a plurality 
of sequential frames of said video; 

(b) displaying said sunmiarization in a first portion of a display; and 

(c) displaying a graphical user interface on a second portion of said display, 
said interface sequentially indicating the relative location of each of said 
plurality of segments within said summarization relative to at least one other 
of said segments as each of said plurality of segments is displayed; and 

(d) displaying said relative location for a first typ e of semantic characterization 
of a said plav event in said video using a first visual indication and 
displaying said relative location for a second type^ semantic event 
characterization of a said plav in said video using a second visual indication 
different fi-om said first visual indication. 

2 (Currently Amended). The method of claim 1 wherein said first and second semantic 
characterizations of a said plav temporally overlap in said summarization plav is of a sport . 

3 (Original). The method of claim 1 wherein said graphical user interface includes a 
generally rectangular region where each of said plurality of segments is indicated within said 
generally rectangular region. 

4 (Original). The method of claim 1 wherein the size of each of said plurality of 
segments is indicated in a manner such that said plurality of segments with a greater number of 
frames are larger than said plurality of segments with a lesser number of frames. 
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5 (Original). The method of claim 4 wherein the size of the regions between each of said 
plurality of segments is indicated in a manner such that said regions between with a greater 
number of frames are larger than said plurality of segments with a lesser number of frames. 

6 (Original). The method of claim 1 further comprising an indicator that indicates the 
current position within said temporal information of a currently displayed portion of said video. 

7 (Original). The method of claim 6 wherein said indicator changes location relative to 
said temporal information as the portion of said currently displayed portion of said video 
changes. 

8 (Canceled). 

9 (Original). The method of claim 1 further comprising 

(a) indicating with an indicator the current position within said temporal 
information of a currently displayed portion of said video; and 

(b) modifying the position of said indicator within said temporal information 
which modifies the displayed portion of said video. 

10 (Original). The method of claim 9 wherein said indicator is modified to a portion of 
said video that is not included within said plurality of segments. 

1 1 (Original). The method of claim 8 wherein said first type of content and said second 
type of content are selectable by a user for presentation to said user. 

12 (Original). The method of claim 1 wherein at least two of said plurality of segments 
are temporally overlapping. 

13 (Original). The method of claim 12 wherein said temporally overlapping segments are 
visually indicated in a manner such that each of said overlapping segments are independently 
identifiable. 
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14 (Original). The method of claim 1 wherein a user selects a portion of said video not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments. 

15 (Original). The method of claim 14 wherein said one of said plurality of segments is 
the segment most temporally adjacent to said portion of said video. 

16 (Original). The method of claim 14 wherein said one of said plurality of segments is 
the next temporally related segment. 

17 (Original). The method of claim 14 wherein said one of said plurality of segments is 
the previous temporally related segment. 

18 (Original). The method of claim 1 wherein a user selects a portion of said video 
included within said plurality of segments, wherein in response thereto, said system presents said 
portion of said video from the start thereof. 

19 (Original). The method of claim 1 wherein a user selects a portion of said video not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments, and wherein said user selects a portion of said video included 
within said plurality of segments, wherein in response thereto, said system presents said portion 
of said video within said plurality of segments. 

20 (Original). The method of claim 1 wherein a user selects a portion of said video not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments, and wherein said user selects a portion of said video included 
within said plurality of segments, wherein in response thereto, said system presents said portion 
of said video within said plurality of segments starting from the beginning thereof 
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21 (Original). The method of claim 1 wherein a user selects a portion of said video not 
included within said plurality of segments, wherein in response thereto, said system presents said 
selected portion not included within said plurality of segments, and wherein after presenting said 
selected portion not included within said plurality of segments presents said selected plurality of 
segments in temporal order without portions of said video not included within said plurality of 
segments, and wherein said user selects a portion of said video included within said plurality of 
segments, wherein in response thereto, said system presents said portion of said video within said 
plurality of segments. 

22 (Original). The method of claim 1 wherein said temporal information is hierarchical 
and is displayed in such a manner to retain a portion of its hierarchical structure. 

23 (Original). The method of claim 1 wherein said temporal information relates to 
overlapping time periods and said temporal information is displayed in such a manner to 
maintain the differentiation of said overlapping tinie periods. 

24 (Original). The method of claim 1 wherein said temporal information is displayed 
within a time line, wherein the temporal information is presented in a plurality of layers in a 
direction perpendicular to the length of said time line. 

25 (Original). The method of claim 1 wherein said temporal information is displayed 
within a time line, wherein textual information is included within said time line. 

26 (Original). The method of claim 1 wherein said temporal information is displayed 
within a time line, wherein additional textual information is displayed upon selecting a portion of 
said time line. 

27 (Original). The method of claim 1 wherein said temporal information is displayed 
together with a time line, wherein additional textual information is displayed together with 
selecting a portion of said time line. 
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28 (Original). The method of claim 1 wherein said temporal information is displayed 
within a time line, wherein additional audio annotation is presented upon presenting a portion of 
said time line. 

29 (Currently Amended). A method of presenting information regarding a video 
comprising a plurality of frames comprising: 

(a) identifying a plurality of different segments of said video, where each of 
said segments includes a plurality of frames of said video; 

(b) displaying, simultaneously with a said segment of said video, a graphical 
user interface including information regarding the temporal location of a 
said segment relative to at least one other of said segments of said video; 
and 

(c) displaying said temporal location for a first typ e of semantic 
characterization of an event in said video using a first visual indication and 
displaying said temporal location for a second type-ef semantic 
characterization of an event in said video using a second visual indication 
different from said first visual indication. 

30 (Original). The method of claim 29 wherein said graphical user interface includes a 
generally rectangular region where each of said plurality of segments is indicated within said 
generally rectangular region. 

3 1 (Original). The method of claim 29 wherein the size of each of said plurality of 
segments is indicated in a manner such that said plurality of segments with a greater number of 
frames are larger than said plurality of segments with a lesser number of frames. 

32 (Original). The method of claim 31 wherein the size of the regions between each of 
said plurality of segments is indicated in a manner such that said regions between with a greater 
number of frames are larger than said plurality of segments with a lesser number of frames. 

33 (Original). The method of claim 29 fiirther comprising an indicator that indicates the 
current position within said temporal information of a currently displayed portion of said video. 
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34 (Original). The method of claim 33 wherein said indicator changes location relative to 
said temporal information as the portion of said currently displayed portion of said video 
changes. 

35 (Canceled). 

36 (Original). The method of claim 29 further comprising 

(a) indicating with an indicator the current position within said temporal 
information of a currently displayed portion of said video; and 

(b) modifying the position of said indicator within said temporal information 
which modifies the displayed portion of said video. 

37 (Original). The method of claim 36 wherein said indicator is modified to a portion of 
said video that is not included within said plurality of segments. 

38 (Original). The method of claim 35 wherein said first type of content and said second 
type of content are selectable by a user for presentation to said user. 

39 (Original). The method of claim 29 wherein at least two of said plurality of segments 
are temporally overlapping. 

40 (Original). The method of claim 39 wherein said temporally overlapping segments are 
visually indicated in a manner such that each of said overlapping segments are independently 
identifiable. 

41 (Original). The method of claim 29 wherein a user selects a portion of said video not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments. 

42 (Original). The method of claim 41 wherein said one of said plurality of segments is 
the segment most temporally adjacent to said portion of said video. 

43 (Original). The method of claim 41 wherein said one of said plurality of segments is 
the next temporally related segment. 
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44 (Original). The method of claim 41 wherein said one of said plurality of segments is 
the previous temporally related segment. 

45 (Original). The method of claim 29 wherein a user selects a portion of said video 
included within said plurality of segments, wherein in response thereto, said system presents said 
portion of said video from the start thereof 

46 (Original). The method of claim 29 wherein a user selects a portion of said video not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments, and wherein said user selects a portion of said video included 
within said plurality of segments, wherein in response thereto, said system presents said portion 
of said video within said plurality of segments. 

47 (Original). The method of claim 29 wherein a user selects a portion of said video not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments, and wherein said user selects a portion of said video included 
within said plurality of segments, wherein in response thereto, said system presents said portion 
of said video within said plurality of segments starting from the beginning thereof 

48 (Original). The method of claim 29 wherein a user selects a portion of said video not 
included within said plurality of segments, wherein in response thereto, said system presents said 
selected portion not included within said plurality of segments, and wherein after presenting said 
selected portion not included within said plurality of segments presents said selected plurality of 
segments in temporal order without portions of said video not included within said plurality of 
segments, and wherein said user selects a portion of said video included within said plurality of 
segments, wherein in response thereto, said system presents said portion of said video within said 
plurality of segments. 

49 (Original). The method of claim 29 wherein said temporal information is hierarchical 
and is displayed in such a manner to retain a portion of its hierarchical structure. 
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50 (Original). The method of claim 29 wherein said temporal information relates to 
overlapping time periods and said temporal information is displayed in such a manner to 
maintain the differentiation of said overlapping time periods. 

51 (Original). The method of claim 29 wherein said temporal information is displayed 
within a time line, wherein the temporal information is presented in a plurality of layers in a 
direction perpendicular to the length of said time line. 

52 (Original). The method of claim 29 wherein said temporal information is displayed 
within a time line, wherein textual information is included within said time line. 

53 (Original). The method of claim 29 wherein said temporal information is displayed 
within a time line, wherein additional textual information is displayed upon selecting a portion of 
said time line. 

54 (Original). The method of claim 29 wherein said temporal information is displayed 
together with a time line, wherein additional textual information is displayed together with 
selecting a portion of said time line. 

55 (Original). The method of claim 29 wherein said temporal information is displayed 
within a time line, wherein additional audio annotation is presented upon presenting a portion of 
said time line. 

56 (Currently Amended). A method of presenting information regarding audio 
comprising: 

(a) identifying a plurality of different segments of said audio, where each of 
said segments includes a temporal duration of said audio; 

(b) displaying simultaneously with said segment of said audio a graphical user 
interface including information regarding the temporal location of a said 
segment relative to at least one other of said segment of said audio; and 
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(c) displaying said temporal location for a first type of semantic 

characterization of an event in said audio using a first visual indication and 
displaying said temporal location for a second type-ef semantic 
characterization of an event in said audio using a second visual indication 
different from said first visual indication. 

57 (Canceled). 

58 (Original). The method of claim 56 further comprising 

(a) indicating with an indicator the current position within said temporal 
information of a currently displayed portion of said audio; and 

(b) modifying the position of said indicator within said temporal information 
which modifies the displayed portion of said audio. 

59 (Original). The method of claim 58 wherein said indicator is modified to a portion of 
said audio that is not included within said plurality of segments. 

60 (Original). The method of claim 56 wherein at least two of said plurality of segments 
are temporally overlapping. 

61 (Original). The method of claim 60 wherein said temporally overlapping segments are 
visually indicated in a manner such that each of said overlapping segments are independently 
identifiable. 

62 (Original). The method of claim 56 wherein a user selects a portion of said audio not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments. 

63 (Original). The method of claim 62 wherein said one of said plurality of segments is 
the segment most temporally adjacent to said portion of said audio. 

64 (Original). The method of claim 62 wherein said one of said plurality of segments is 
the next temporally related segment. 
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65 (Original). The method of claim 62 wherein said one of said plurality of segments is 
the previous temporally related segment. 

66 (Original). The method of claim 56 wherein a user selects a portion of said audio 
included within said plurality of segments, wherein in response thereto, said system presents said 
portion of said audio from the start thereof 

67 (Original). The method of claim 56 wherein a user selects a portion of said audio not 
included within said plurality of segments, wherein in response thereto, said system presents one 
of said plurality of segments, and wherein said user selects a portion of said audio included 
within said plurality of segments, wherein in response thereto, said system presents said portion 
of said audio within said plurality of segments. 

68 (Original). The method of claim 56 wherein a user selects a portion of said audio not 
included within said plxirality of segments, wherein in response thereto, said system presents one 
of said plurality of segments, and wherein said user selects a portion of said audio included 
within said plurality of segments, wherein in response thereto, said system presents said portion 
of said audio within said plurality of segments starting from the beginning thereof. 

69 (Original). The method of claim 56 wherein a user selects a portion of said audio not 
included within said plurality of segments, wherein in response thereto, said system presents said 
selected portion not included within said plurality of segments, and wherein after presenting said 
selected portion not included within said plurality of segments presents said selected plurality of 
segments in temporal order without portions of said audio not included within said plurality of 
segments, and wherein said user selects a portion of said audio included within said plurality of 
segments, wherein in response thereto, said system presents said portion of said audio within said 
plurality of segments. 

70 (Original). The method of claim 56 wherein said temporal information is hierarchical 
and is displayed in such a manner to retain a portion of its hierarchical structure. 
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71 (Original). The method of claim 56 wherein said temporal information relates to 
overlapping time periods and said temporal information is displayed in such a manner to 
maintain the differentiation of said overlapping time periods. 

72 (Original). The method of claim 56 wherein said temporal information is displayed 
within a time line, wherein the temporal information is presented in a plurality of layers in a 
direction perpendicular to the length of said time line. 

73 (Original). The method of claim 56 wherein said temporal information is displayed 
within a time line, wherein textual information is included within said time line. 

74 (Original). The method of claim 56 wherein said temporal information is displayed 
within a time line, wherein additional textual information is displayed upon selecting a portion of 
said time line. 

75 (Original). The method of claim 56 wherein said temporal information is displayed 
together with a time line, wherein additional textual information is displayed together with 
selecting a portion of said time line. 

76 (Original). The method of claim 56 wherein said temporal information is displayed 
within a time line, wherein additional audio annotation is presented upon presenting a portion of 
said time line. 

77 (Original). The method of claim 29 wherein a user selectable skip function skips a set 
of frames to a modified location of said video in at least one of a forward temporal direction or a 
reverse temporal direction, and displays said video at said modified location. 

78 (Original). The method of claim 29 wherein a user selectable skip function skips to a 
later temporal segment or a previous temporal segment, and displays said video at said later 
temporal segment or said previous temporal segment, respectively. 
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79 (Original). The method of claim 29 wherein a user selectable scan function skips a set 
of frames to a modified location of said video in at least one of a forward temporal direction or a 
reverse temporal direction, and displays said video at said modified location, and thereafter 
automatically skips another set of frames to another modified location of said video in at least 
one of said forward temporal direction or said reverse temporal direction, and displays said video 
at said another modified location. 

80 (Original). The method of claim 79 wherein at least one of said forward temporal 
direction and said reverse temporal direction are consistent with said different segments. 

81 (Original). The method of claim 80 wherein said display of said video is at the start of 

the respective one of said different segments. 

> 

82 (Previously Presented). The method of claim 80 wherein said display of said video is 
at a predetermined offset within the respective one of said different segments. 

83 (Previously Presented). The method of claim 29 wherein said graphical user interface 
displays a respective image associated with at least a plurality of said different segments. 

84 (Previously Presented). The method of claim 82 wherein said respective image 
associated with the currently presented said different segments is visually highlighted. 

85 (Previously Presented). The method of claim 83 wherein during presentation of said 
video said visually highlighted respective images are said highlighted in a substantially regular 
interval while the sequence of said presentation of said video is at substantially irregular 
intervals. 

86 (Previously Presented). The method of claim 56 wherein the presentation of said 
different segments may be modified by a plurality of different functions, and wherein the user 
may customize another function, not previously explicitly provided, by combining a plurality of 
said plurality of different functions into a single function. 
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